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Description 

nF lpnPTUP INVENTION 



FtCI n HF THE lNVENHUN 

ln l ri-nnHin""f T "»"^" TI °'' 

Sons have some advantages over surface-based graph cal W« rep ^ y w ^ 

S o» actions such as object ^^J^^XSmA tor example, by S. Gtoson in "Beyond volume 
15 resentations to model physically-based ob|ect ■J^SSSS voxel-based objects", in Proc. Eurograph.cswork- 
eSering: visualization, haptic exploraton. and phyacd mod*** vox* ^ ^ .^e^cnto 

Sop in LaBzafion in Scientific *^»™^£^ a fast algorithm tor deforming vo.umetnc 

^ro^^^ 

SS^accurmlating color as they pass^^ 

3* is plojected onto the image fxane. ^^^^ 5^2^^^ for each volume element are need«l 
about the cdor. transparency, surface normal, ard sample intensity or density value, and a 

. Sa,ec*enderivedf^ 

material classHication. For example, the density value m 9 ra °* u nrooerties to object elements. 

t 0004] IncorrputergrapNcs.mequal^ 

L rendering process. An il—o nmjM *» ^tconpUer gaphics. a typical illumination mode. . the 
3 o ligms^ces. reflect^ 

Phong illumination model, which expresses tne ugm 

l r -K a l a l obl + K d l L l obI (NL) + K B l L l oh ,CrW) n , 

ate surface normals can have a large effect o .the ^ erc ^ J 3 onl a relatively sma il number of positions, est- 
,o graphical representations, the surface "^^^^rrSrSnt for high quality rendering. In Volume Graph.^ 

Sng me surface norma, at '^SSSS^ ^ ^ " "* " "* 

estimating surface normals is especially chal eng ng ^ of density ^es. 

data. Instead, surface normalsareusual^ 

,00061 It is important to note that the calculation o «^J» tic data ^ration where a force 

« Tvo ume Revering. An accurate surface Accurate surface norma. ^- 

feedback device is used by the user sensK»e than the eye to surface -rreg^ 

mation is essentia, in ^2*, physically-based interactions between ob.ects 

ularities. An accurate surface normal is also . . _ dwends on ,hese normals. 

Sale the calculation of impact and frictional » *.«*> d* ^ 
50 [00071 Many methods have been used to add W*^"™ ^ tne data is represented as a binary field 
Ss depend on the data representation. Different methodsare " * ^ e ^ 1jeld , sucn as a sampled 
Sire data samples are either empty or lull of a gwen materia or » » *J£ *e discussed, for example, in "Volume 

«rnS^s« 

[OMsT Inortertoestimatesurfacenormalswhenthe ^JJ^J^^ change fcs«alo««4tur- 
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y,z)by: 

g x = i(x+i.y.zH(x-i,y,z), 



w 



20 



25 



30 



35 



g yS |(x,y+l.z)-l(x.y-l,z). 
g 2 = l(x,y,z+1)-Kx,y,z-1). 

Visualization ^4. pp. 100-107. Washington, DC, W.^ "v visurtafion and Computer Graphics, vol. 
of this smoothed image. 

;;inilMnrrY" CTWlWEMTI0N . ..^rfi, 

the surface normal magnitude. , Rendering, they have been used exclusively tot 

001 31 While others have used volumetnc distance "J™!, ^ in ^ systems as minimum distances 
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20 



25 



^^s.Sstancemappoirtsinthe^ecliono.ihesurtacenormal. 
2) a zero distance map value H , e is ins i de the obiect. The d.stence to ^ 

sentation. calculating surface normals 

f eedbackdeviceandforcalculat,ngob ie ctpenetr lherea ,e many ways to calculate the 

modeling. _ irres data tor a volumetric object representaWn.fterear^ y ^ ^ 

100201 ^To^th^ 

volumetric distance map. H me source or a constraineo i op* model, 

equation otasphereora^tch^ 

used totind the n^n-mum^n^ 

various algorithms used in graphical coinsio continuous field, such as a^ iensrty J« polygonal 

to the nearest surface '^^^^ 7 ^ ^«^bXw Lorensen 

Knowledge of the ^ ^^ ^es using a technique such w. pp. 163-169. 

spline patch surface model at button 3D construction algorithm , in Proa S»Qiw ™ ^ 

and H. Cline. in "^^.^^ts^Zcted surface. Forabir^seg^ed^^^^ caiculated 
l^.andthenc^cUatedj^m^^ ^ lield a«llhentr^^ o «^%^ ea p pra ^. 
be smoothed to form a j»*™°^ by CRC Press, in 

fromthebinary*^ 

tions that are described for «^' e ' s couW also be fitered to obtain i a srrw rendering. 

Boca Raton. 

[0021] Thesub)ects^emj.n^ 

. n ^caicutefionofthemagnttudeanddirectonof 

iSing surface ~'^ P ^lS S crees in haptic **• 
EhatS^ 

10024) With respect to <*^ n ^™^ otner ^ a physically-based Simula ™ ^ 

Lisdetectedw^ent^^ 

interaction can be calwlate^ 

tact point. The sub,ect system o en cc*gd^ on and for generating ^ therej ^ ^ ^ 
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„ onte used tor calculating the lighting eHects n a 

nal object model; 

..*.—«-"———' — — •* 

Figure SB is a diagrammatic representat.cn of the vector 
the illumination effects; 

for Volume Rendering; 



for representing a volumetric element 
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Figure 6B 



Figure 7 



is a data structure written in the C programming 
distance map; 



element density and the 
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Figure 8 



sources. 
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[0031] Referring to Figure 4, in ray w»" y 
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pixelinmeviewplaneS^^ 
poTnt, the object color 58. 

nation model to calculate the light reflected at each sample po,nt 

is composited onto the ray color 66. ^ int0 ^ volume in the viewing 

l00 32] Refem^toF.gureSA.raysf^^^ 
direction earning toe 
pSor'^ 

tm color of each element includes a «^^u^S!X^ and the *J 22 S3 

light is calculated using an « 
o sample point. P. 78. depends on the direction. L 80 " 9 ™! ^ norma | S are not usually stored in the vo^ 
SunSe normal. N. 84 at P. 78. Unlite pohjn f^S^S-o^^t-^^^ 
umetric data. Hence, the surface normal. N. 78. a h Volume Rendering, each element in the vol- 

rSeSents near the sample P^Refemngto^^^ 

umt hi a structure such as the one ^^SbS-'. *• data ^ 
)5 value 86 for the object density or « 

20 Unitudeolthedfet^^ 

" S Referring to Figure 7. differences J^^g^SSe* The object present where the .mage 
Se method of the subject invention are illustrated .* ^J^^^y^isitecoaBWdi^^ 
sbSasi.lus.rateda.90. and ^^^£^f£Xm^***"»«^ 
that corresponds to the object in Figure 7(a). Note that it nasa ^T" 1iidetne ^01; and values that decrease 

- S Snaeasevvfthd^ 
wtdsSefrom^^ 

e g 98 Figure 7(d) is the sampled version of Figure 7(b) ^JHJJ * e ^ points in Figure 7(d) vary smoothly 
Scfmap at me same position. Notice that the « 

SoLtheirnage. Because of tWs smooth varat^ 

instructed more accurately and ^^^^^^V^^ a ^ mm T , 
figure 7(c) can be reconstructed. Figure 7(e) • ■ "J* 'JEJ gradient estimator. Note that the direction of 
cited from the sampled image of Figure 7(c) m or 102 ^ 10 4. Using th.s graft- 

^egradientscanvarysightontlytorne 

entesi^ 
erating lighting effects for volume rendering: 
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. . . volRender.c • 0 f an 

che volume onto a 3D progralM . 

Revised from eanw * h .1 intensity values 

» July. 19^ hv s - Gibson ' 
' MERL Cambridge. 
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/* includes */ _ 
^include "volRender.n 

vis^Display global variables •/ 

static int xSize, ySize. >Si». 

static int imgSize; 

static int nLi *?"' , m . 
static int vertexOffseLlEU. 

static float voxelSizeX. voxelSizeY. voxelSizeZ; 
ESS "oat scale* scaleV. scaleZ; 

static float imageGaxn; 

static VisLight lights (MAX LIGHTS] ; 

static VisFVector view; 
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main 
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void main (int argc, char 

char dataFileName[60}; 
char clutFileName 60 ; 
char LlutFileName(60] ; 

int i, 1. t index; 
int' si2e. iwgArea; 
int fd, n; 

XEvent event; 

VisVoxel * voxel; 
VicColor *cliarTmaO«: 
VisFColbr 'image; 
visColorLut clut; 
' visTranspLut tlut; 



•argv) 



/* 3D data volume */ 
r projected image (char) */ 

„J, of'transparency loo.up caoies •/ 



» m ,.u A a nd image arrays •/ 

/• nllocate space tor the eaui ana 

sire = xSize * ySize ' * siie0 e (VisVoxel )) i ' 

voxel - (VisVoxel * 1 mallocUize 
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. charlnvage = (VisCoior 

open and read «j. ^ . 

readtfd. voxel, size 
close(fd); 

r clear the ima;ie Lo black •/ 
VisClearlmaselimage) : 

render the volume da ta '/ ^ . 

Vi.Proj.ct(uox.l. clut. qw #/ 

closelfd); 

free the data allocation •/ 
freei(VisVo«l M voxel) 
free visFColor M 1 
free Viscolor ") charlmage); 



) 



♦ VisProject - casing rayc from the 

along the ray and then cu w ^ 

ordering • 

1 mt i. j. k- 4- kk: 

int index, nlndex: 



llotU/ay^dx. ddx. ddy. ddz, 
"loft »»P»" "-pi. W*J. t«p3: 
float wlBl: aC cTransp; 
Float transp. opacity. accT.a 

float mag. diSt: 
VisFColor color. shadingColor ; 
VisFVector grad; 



planeSiz* = xSixe ' ySi" = „ along a rzy 

,. u SLSlSTS SS-tUd. order 

* through the data m th. kk 
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2) 



■.l. color along the ray oy t« ^ 
point onto Che i~a«e plane pixel. 



accTransp = 

col^r - color., « color.b - CO; 
transp = 1.0; 



75 



20 



50 



while 1(1* < i-QSi") « i-ySSlLyii' liiJi.^.i" SPB " *' 

/- 3) calculate the L + Rt o)(21 * klc * Tl ° 1; 



, .the (xy-xl lies i««i»e o£ the data volume / 
/♦ make sure the ix.y.*' 
i f [(x >= 0) U I* < xSixe-1 « 

" y >= o) m ty < ysize-i « 

* >s oi U C < xSiie-l) ) I 



tonp 0 . ddx'dd,; ten** - cox dy. P 

W ei,hts for Crilinea: ^SS^l^*-^"- 2 - >010 ' 



: ksa/arar est- 

*' n-ddz- will = tempO-dx; ■ '-^Si Sp, = tS'dii 

1£ tdiSt ' = " 0, , H«e the indices correspond to 

,. indices of 8 .-"^^^.-SoM. 1 - > °° 1 ' 2 ' >01 °' ' 

for (nindex = 1. "Index < B: nlndex-l ( 
) 
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sign = VectoxDottgrad, view* ; 
if {sign 0) ( 

shadingColor= color. fcsUad ingColor) ; 

visGetShauedCoiorlgrad. mag. 

color'.g - shadingColor.g; 
color. b - shadingColor.b; 



) 



) 



. voxel onto Che view plane 



in^geiinclexl.r - . „l=r. S: 



accTransp *= transp; 



) 

) 

) 

index** ; 



return; 

) 



Vi,0.ts«plecolor - triIin earlv interpolating the 
u!ins « eolot looteup table. 



, mlorCint 'values, float -ight. VisColorLut =lut. 
visGetSampleCclorUnt^val . 

t 

int i: 

visColor temp; 

eolor ., r = color-» B - «l«-> b " 0; 

°ci« ^Hv'-'-eUti) ' Uloat, te»p.r / «|.0. 
color->r ♦ * vis ^t^ • weight i ' <£l° atl ten,p ? / 255 0 



return; 



) 
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. visGetSampleTransp — , r n iMir ly interpolating 



float Q(int , valueS( float --tight. VisTranspLut tlucl 

VisGetSampleTransp tmt 



( 

int i; 

float transp - u. 



!l ^htlll • .tran R p(valuesti)): 
} /« max char value is 255 •/ 

transp /■ 255.0; 
return transp; 

} 



• VisGetSampleDist - „.<ii ne arly interpolating 

: ^. tr ;:- t -r;:„nnrn. b J Sirs*— • 

the distances to near-st ^ 

*/ 

( 

int i: 

float dist =0; 
return dist; 

} 



VisGetSawpleGrad ^ 



1 int i. j. k. index; 
float mAg; 
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™ . • — -» • »••<-" • • " 

) 

else ( 
may ■ 0; 

} 

i£ (mag > 0) { 
gracl->* /= way: 
grad->y /- ^y; 
griicl->2 /= mag; 

) 

else ( 

35Zd"« • grad->y = g«d->2 = 0; 

) 



return mag; 



VisGetShadedColor - 



with diffuse and specular reflection. ^ 

vole VisGeUShadedColorlVisFVector grad. float »e 5 ' VisFColor 'color, 

i y 

int i; . 
floac dScale, temp, sScaie: 
VisFColor shadeColor; 

shadeColor.r = shadeColor.g = shadeColor.b = 0; 

if {visibility l« °> , I . 

f D - li = 0: i < ..Lights: I , prnr ./ 

V et She disuse lighting ^ f^or : 
temp = VectorDottgraa. UghtiUJ 
i£ (temp > 0) 

dScale = may • kd • temp: 
else 

dS " 18 = , Not e the use of the halfway 

,. get the specular light scalin, tactor. Note 
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• far away (see Foley. Van Dam. elal.). 
^.VectorDoUgr.d.'li.ht-lil.h-V.ctor,; 



else 

sScUe « 0: # colo— >r * sScale) ; 



15 



) 

} 

•color = shadeColor; 
return; 



1. Ins 
elements, 



ements, • * ^ 

face normal thereof, nearest 

■ «*ihofli<*ance of said data element to the nearest 
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Fig. 3A 
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Fig. 3B 
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FOR EACH PIXEL IN THE VIEWING PLANE 



CAST RAYS INTO THE VOLUME 
54 



_L 



5AAAPLE VOLUMETWC DATA 
AT INTERVALS ALONG THl RAY 

56 



AT EACH SAMPLE. 



SB- 



INTERPOLATE OBJECT COLOR 



62 ^I^TIW^TE^BJ^SURFACr*^] 
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,,cc SURFACE INFORMATION 

MODEL TO ESTIMATE THE 
. REFLECTED LIGHT 



HI 



J CO»AP05nES»MRtRtSUl10NR«COlOR 




Fig. 4 
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r TYPE DEF VOLUME ELEMENT STRUCT { 

B6 »- |NT DENSITY; 

} VOLUME ELEMENT; 
\ Y ~~~ 

Fig. 6A 



C TYPE DEF VOLUME ELEMENT STRUCT { 

INT DENSITY; 
8B ^ INT DISTANCE; 

) VOLUME ELEMENT; 

— sf ' 

Fig. 6B 
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Fig. 7C 
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Fig- 7D 




Fig. 7E 




Fig. 7F 
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r^PTTgESENTATlON DlSTAt^^UJffi 
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PARAMETRIC 
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POLY AGONAL Hi 
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SAMPLING 
CONTINUES 
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BINARY 
SAMPLING 
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GEOMETRY/ 
CONSTRAINED OPTIMIZATION 
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nKTANCE TO CLOSEST POLYGON 
(FROM PHYSICS BASED GRAPHICS) 
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ISO SURFACE 
GENERATION 
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Fig. 8 



22 



